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IN THE CLAIMS: 

This listing of claims will replace all prior versions, and listings, of claims in the 
application. Please amend claims 1-2, 8, 10-12, 18-22, 28-32, 38-42 and 48-50 as follows: 

1 . (Currently Amended) A multiplexing apparatus which multiplexes a plurality of 
audio elementary data streams and a plurality of video elementary data stream streams to 
generate one multiplexed stream, the multiplexing apparatus comprising: 

encoders receiving video [[date]] data from a video source, receiving audio data from an 
audio source, encoding the video data into the video elementary data streams, encoding the audio 
data into the audio elementary data streams, dividing the video elementary data streams into a 
plurality of video data units and dividing the audio elementary streams into a plurality of audio 
data units; 

a memory which stores the plurality of video and audio data units that are composed of 
an arbitrary amount of said video and audio elementary data streams; 

an instruction generating means for calculating an order of multiplexing the video data 
units and the audio data units based on storage location locations supplied by the encode r 
encoders , for generating an instruction set of a plurality of multiplexing instruction data which 
describe the storage location and order of multiplexing of each data unit and for storing the 
multiplexing ins truction data instruction set into the memory in an o f der that said plurality o f 
video and audio data units are to be multiplexed ; and 

a multiplexed stream generating means for reading the instruction set from the memory, 
for generating one multiplexed stream by reading the multiplexing instructi o n data and data units 
sequential ly from the memory in a predetermined order based upon the instruction set and for 
outputting the data [[unit]] units corresponding to the multiplexing instruction [[data]] set . 
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2. (Currently Amended) A multiplexing apparatus which multiplexes a plurality of 
video elementary data streams and a plurality of audio elementary data streams to generate one 
multiplexed stream, the multiplexing apparatus comprising: 

encoders receiving video [[date]] data from a video source, receiving audio data from an 
audio source, encoding the video data into the video elementary data streams, encoding the audio 
data into the audio elementary data streams, dividing the video elementary data streams into a 
plurality of video data units and dividing the audio elementary streams into a plurality of audio 
data units; 

a memory which stores the plurality of video and audio data units that are composed of 
an arbitrary amount of said video and audio elementary data streams; 

an instruction generating means for calculating an order of multiplexing the video data 
units and audio data units based on storage location locations supplied by the encoders, 
generating an instruction set of a plurality of multiplexing instruction data which describe the 
storage location and order of multiplexing of each data unit while generating command 
instruction data having stated therein an instruction for execution of a data processing to be 
executed in an arbitrary position in the multiplexing instruction data, and storing the 
multiplexi ng instru c t ion data instruction set and command instruction data into the memory in-an 
order that the plurality of video and audio data units and ex e cution instruction are t e-he 
multiplexed ; 

a multiplexed stream generating means for reading the instruction set from the memory, 
for generating one multiplexed stream including the video and audio elementary data streams 
and command data by reading the m ultiplexing instruction data; data units and command 
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instruction data sequentially from the memory in a predetermined order based upon the 
instruction set and for outputting the data [[unit]] units corresponding to the multiplexing 
instruction [[data]] set, after reading the multiplexing instruction [[data]] set, or by outputting 
command data having stated therein the execution instruction stated in the command instruction 
data, after reading the command instruction data; and 

a command executing means which is supplied with a multiplexed stream output from the 
multiplexed stream generating means and makes a processing corresponding to an instruction 
content stated in the command data when a data row in the multiplexed stream is command data, 
or outputs the multiplexed stream as it is when the data row in the input multiplexed stream is 
video and audio elementary data stream. 

3. (Previously Presented) The apparatus as set forth in claim 2, wherein: 

the multiplexed stream generating means outputs, synchronously with the multiplexed 
stream, an ID flag for identifying which data row in the multiplexed stream is command data or 
elementary data stream; and 

the command executing means judges based on the ID flag whether the data row in the 
multiplexed stream is command data or elementary data stream. 

4. (Previously Presented) The apparatus as set forth in claim 2, wherein: 

the instruction generating means generates, when inserting stuffing data into an output 
multiplexed stream, command instruction data having stated therein an instruction for inserting 
the stuffing data and an amount of the stuffing data; 
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the multiplexed stream generating means outputs, when the command instruction data has 
stated therein an instruction for inserting the stuffing data, the command data having stated 
therein the content stated in the command instruction data; and 

the command executing means inserts, when the command data has stated therein an 
instruction for inserting the stuffing data, stuffing data whose amount is stated in the command 
data to a position of the command data in the multiplexed stream. 

5. (Previously Presented) The apparatus as set forth in claim 2, wherein: 
the instruction generating means generates, when deleting data from an output 

multiplexed stream, command instruction data having stated therein a data delete instruction and 
data amount to be deleted; 

the multiplexed stream generating means outputs, when the command instruction data has 
stated therein an instruction for deletion of data, the command data having stated therein the 
content stated in the command instruction data; and 

the command executing means deletes, when the command data has stated therein an 
instruction for deletion of the data, an amount of data stated in the command data from a 
multiplexed stream next to the command data. 

6. (Previously Presented) The apparatus as set forth in claim 2, wherein: 

the instruction generating means generates, when inserting arbitrary data into an output 
multiplexed stream, command instruction data having stated therein an instruction for insertion 
of the arbitrary data; 
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the multiplexed stream generating means outputs, when the command instruction data has 
stated therein an instruction for insertion of the arbitrary data, the command data having stated 
therein the content stated in the command instruction data; and 

the command executing means inserts, when the command data has stated therein an 
instruction for insertion of the arbitrary data, the arbitrary data stated in the command data to a 
position of the command data in the multiplexed stream. 

7. (Previously Presented) The apparatus as set forth in claim 2, wherein: 

the instruction generating means generates, when sending a timing acknowledgment in an 
arbitrary timing in an output multiplexed stream, command instruction data having stated therein 
an instruction for sending a timing acknowledgment; 

the multiplexed stream generating means outputs, when the command instruction data has 
stated therein an instruction for sending the timing acknowledgment, the command data having 
stated therein the content stated in the command instruction data; and 

the command executing means sends, when the command data has stated therein an 
instruction for sending the timing acknowledgment, the timing acknowledgment in a position of 
the command data in the multiplexed stream. 

8. (Currently Amended) A multiplexing apparatus which multiplexes a plurality of 
video elementary data streams and a plurality of audio elementary data streams to generate one 
multiplexed stream, the multiplexing apparatus comprising: 

encoders receiving video [[date]] data from a video source, receiving audio data from an 
audio source, encoding the video data into the video elementary data streams, encoding the audio 
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data into the audio elementary data streams, dividing the video elementary data streams into a 
plurality of video data units and dividing the audio elementary streams into a plurality of audio 
data units; 

a memory which stores the plurality of video and audio data units that are composed of 
an arbitrary amount of said video and audio elementary data streams; 

a counting means for indicating a count which indicates a data occupancy of the memory; 

an instruction generating means for calculating an order of multiplexing the video data 
units and audio data units based on storage location locations supplied by the encoders, 
generating an instruction set of a plurality of multiplexing instruction data which describe the 
storage location and order of multiplexing of each data unit and storing the multiplexing 
instruction [[data]] set into the memory in an order that said plural it y of video and a ud io data 
units are to be multiplexed ; and 

a multiplexed stream generating means for reading the instruction set, for generating one 
multiplexed stream by reading the multiplexing instruction data and data units sequentially from 
the memory in a predetermined order based upon the instruction set and outputting the data 
[[unit]] units corresponding to the multiplexing instruction [[data]] set; 

the instruction generating means adding a data amount of a data unit corresponding to the 
multiplexing instruction data to the count; and 

the counting means subtracting the data amount of output data unit from the count. 

9. (Previously Presented) The apparatus as set forth in claim 8, wherein: 
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the memory is divided into a plurality of storage areas correspondingly to the types of the 
elementary data streams and the elementary data streams is stored into corresponding storage 
areas; 

the counting means holds a plurality of counts corresponding to the storage areas in the 
memory; 

the instruction generating means adds the data amount of a data unit corresponding to the 
multiplexing instruction data to a count corresponding to a storage area in which the data unit is 
stored; and 

the counting means subtracts the data amount of data unit output from the memory from a 
count corresponding to the storage area in which the data unit is stored. 

10. (Currently Amended) A multiplexing apparatus which multiplexes a plurality of 
video elementary data streams and a plurality of audio elementary data streams to generate a 
plurality of multiplexed streams, the multiplexing_apparatus comprising: 

encoders receiving video [[date]] data from a video source, receiving audio data from an 
audio source, encoding the video data into the video elementary data streams, encoding the audio 
data into the audio elementary data streams, dividing the video elementary data streams into a 
plurality of video data units and dividing the audio elementary streams into a plurality of audio 
data units; 

a memory which stores the plurality of video and audio data units that are composed of 
arbitrary amounts of said video and audio elementary data streams; 

an instruction generating means for calculating an order of multiplexing the video data 
units and audio data units based on storage location locations supplied by the encoders, 
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generating an instruction set of a plurality of multiplexing instruction data which describe the 
storage location and order of multiplexing of each data unit and storing the multiplexing 
instruction [[data]] set into the memory i n an order that said plurality of video a n d audio data 
units are t e-b e mul tiplexed ; and 

a multiplexed stream generating means for generating a plurality of multiplexed streams 
by reading the multiplexing instruction data and data units sequentially in a predetermined order 
based upon the instruction set from the memory, and outputting the data [[unit]] units 
corresponding to the multiplexed instruction [[data]] set; 

the instruction generating means stating, in the multiplexing instruction data, the type of a 
multiplexed stream resulted from multiplexing data units corresponding to the generated 
multiplexing instruction data; and 

the multiplexed stream generating means generating the plurality of multiplexed streams 
by switching the outputting of the data unit read correspondingly to the multiplexed stream type 
stated in the multiplexing instruction data. 

1 1 . (Currently Amended) A multiplexing method in which a plurality of video 
elementary data streams and a plurality of audio elementary streams are multiplexed to generate 
one multiplexed stream, the multiplexing method comprising the steps of: 

receiving video data from a video source, receiving audio data from an audio source, 
encoding the video data into the plurality of video elementary data streams, encoding the audio 
data into the plurality of audio elementary data streams, dividing each said elementary data 
streams into a plurality of data units that are composed of an arbitrary amount of said elementary 
data stream and storing said data units into a memory; 
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calculating an order of multiplexing video data units and audio data units based on 
storage l o c ation locations , generating multiplexing an instruction [[data]] set which describe the 
storage location and order of multiplexing of each said data unit and storing the multiplexing 
instruction [[data]] set into the memory in an order that said plurality of video and audio data 
units are to be multiplexed ; and 

reading the instruction set, generating a multiplexed stream by reading the multi plexing 



upon the instruction set and outputting the data [[unit]] units corresponding to the multipl e xing 
instruction [[data]] set. 

1 2. (Currently Amended) A multiplexing method in which a plurality of video 
elementary data streams and a plurality of audio elementary data streams are multiplexed to 
generate one multiplexed stream, the multiplexing method comprising the steps of: 

receiving video data from a video source, receiving audio data from an audio source, 
encoding the video data into the plurality of video elementary data streams, encoding the audio 
data into the plurality of audio elementary data streams, dividing each elementary data streams 
into a plurality of data units that are composed of an arbitrary amount of the elementary data 
stream and storing said data units into a memory; 

calculating an order of multiplexing video data units and audio data units based on 
storage location locations , generating multipl e xing an instruction [[data]] set which describe the 
storage location and order of multiplexing of each said data unit while generating command 
instruction data having stated therein an instruction for execution of a data processing to be 
executed in an arbitrary position in the multiplexing instruction data, and storing the 




data units sequentially from the memory in a predetermined order based 
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multiplexing instruction [[data]] set and command instruction data into the memory in an order 
t hat said video an d audio data units and execution instruction ar c to be multiplexed ; 

reading the instruction set, generating a multiplexed stream including the video and audio 
elementary data streams and command data by reading the multipl ex ing instruction data, th e data 
units and command instruction data sequentially from the memory in a predetermined order 
based upon the instruction set and outputting the data [[unit]] units corresponding to the 
multipl e xing instruction [[data]] set, after reading the multiplexing instruction [[data]] set, or by 
outputting command data having stated therein the execution instruction stated in the command 
instruction data, after reading the command instruction data; and 

being supplied with a multiplexed stream output from the multiplexed stream generating 
means and making a processing corresponding to an instruction content stated in the command 
data when a data row in the multiplexed stream is command data, or outputting the multiplexed 
stream as it is when the data row in the multiplexed stream is video and audio elementary data 
stream. 

13. (Previously Presented) The method as set forth in claim 12, further comprising the 
steps of: 

synchronously outputting an ID flag, for identifying which data row in the multiplexed 
stream is command data or elementary data stream, with the multiplexed stream; and 

determining based on the ID flag whether the data row in the multiplexed stream is 
command data or elementary data stream. 
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14. (Previously Presented) The method as set forth in claim 12, [[wherein]] further 
comprising the steps of: 

when inserting stuffing data into an output multiplexed stream, generating command 
instruction data having stated therein an instruction for inserting the stuffing data and an amount 
of the stuffing data; 

when the command instruction data has stated therein an instruction for inserting the 
stuffing data, outputting the command data having stated therein the content stated in the 
command instruction data; and 

when the command data has stated therein an instruction for inserting the stuffing data, 
inserting stuffing data whose amount is stated in the command data into a position of the 
command data in the multiplexed stream. 

15. (Previously Presented) The method as set forth in claim 12, further comprising the 
steps of: 

when deleting data from an output multiplexed stream, generating command instruction 
data having stated therein a data delete instruction and data amount to be deleted; 

when the command instruction data has stated therein an instruction for deletion of data, 
outputting the command data having stated therein the content stated in the command instruction 
data; and 

when the command data has stated therein an instruction for deletion of the data, deleting 
an amount of data stated in the command data from a multiplexed stream next to the command 
data. 
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16. (Previously Presented) The method as set forth in claim 12, further comprising the 
steps of: 

when inserting arbitrary data into an output multiplexed stream, generating command 
instruction data having stated therein an instruction for insertion of the arbitrary data; 

when the command instruction data has stated therein an instruction for insertion of the 
arbitrary data, outputting the command data having stated therein the content stated in the 
command instruction data; and 

when the command data has stated therein an instruction for insertion of the arbitrary 
data, inserting the arbitrary data stated in the command data into a position of the command data 
in the multiplexed stream. 

17. (Previously Presented) The method as set forth in claim 12, further comprising 
the steps of: 

when sending a timing acknowledgment in an arbitrary timing in an output multiplexed 
stream, generating command instruction data having stated therein an instruction for sending a 
timing acknowledgment; 

when the command instruction data has stated therein an instruction for sending the 
timing acknowledgment, outputting the command data having stated therein the content stated in 
the command instruction data; and 

when the command data has stated therein an instruction for sending the timing 
acknowledgment, sending the timing acknowledgment in a position of the command data in the 
multiplexed stream. 
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18. (Currently Amended) A multiplexing method in which a plurality of video 
elementary data streams and a plurality of audio elementary data streams are multiplexed to 
generate one multiplexed stream, the multiplexing method comprising the steps of: 

receiving video data from a video source, receiving audio data from an audio source, 
encoding the video data into the plurality of video elementary data streams, encoding the audio 
data into the plurality of audio elementary data streams, dividing each elementary data streams 
into a plurality of data units that are composed of an arbitrary amount of the elementary data 
stream and storing the data units into a memory; 

calculating an order of multiplexing video data units and audio data units based on 
storage location locations , generating multiplexing an instruction [[data]] set which describe the 
storage location and order of multiplexing of each said data unit and storing the multiplexing 
instruction [[data]] set into the memory in an order that the plurality of video -and audio data 
units are to be multiplexed ; and 

reading the instruction set, generating a multiplexed stream by reading the multiplexing 



the instruction set and outputting the data [[unit]] units corresponding to the multiplexi ng 
instruction [[data]] set; 

in the instruction generating step, adding the data amount of a data unit corresponding to 
the multiplexing instruction [[data]] set to a count in a counter indicating data occupancy of the 
memory; and 

subtracting the data amount of data unit output from the memory from the count. 




data units sequentially from the memory in a predetermined order based on 
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1 9. (Currently Amended) The method as set forth in claim 1 8, further comprising the 
steps of: 

dividing the memory in a plurality of storage areas correspondingly to the types of the 
elementary data streams and storing the supplied elementary data streams into corresponding 
storage areas; 

holding a plurality of counts corresponding to the storage areas in the memory in the 
counter; 

adding the data amount of a data unit corresponding to the multiplexing instruction 
[[data]] set to a count corresponding to a storage area in which the data unit is stored; and 

subtracting the data amount of data unit output from the memory from a count 
corresponding to the storage area in which the data unit is stored. 

20. (Currently Amended) A multiplexing method in which a plurality of video 
elementary data streams and a plurality of audio elementary data streams are multiplexed to 
generate a plurality of multiplexed streams, the multiplexingjnethod comprising the steps of: 

receiving video data from a video source, receiving audio data from an audio source, 
encoding the video data into the plurality of video elementary data streams, encoding the audio 
data into the plurality of audio elementary data streams, dividing each elementary data streams 
into a plurality of data units that are composed of an arbitrary amount of the elementary data 
stream and storing the data units into a memory; 

calculating an order of multiplexing video data units and audio data units based on 
storage location locations , generating multiplexing an instruction [[data]] set which describe the 
storage location and order of multiplexing of each said data unit and storing the multiplexi ng 
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instruction [[data]] set into the memory in an order that the plurality of video and audio data 



stating, in the multiplexing instruction [[data]] set, the type of a multiplexed stream 
resulted from multiplexing data units corresponding to the multiplexing instruction [[data]] set; 
and 

reading the instruction set, generating a plurality of multiplexed streams by reading the 



order based upon the instruction set and outputting the data [[unit]] units corresponding to the 
multiplexing instruction [[data]] set and switching the outputting of the data unit correspondingly 
to the multiplexed stream type stated in the multipl e xing instruction [[data]] set. 

2 1 . (Currently Amended) A multiplexer for multiplexing a plurality of video 
elementary data streams and a plurality of audio elementary data streams to generate a 
multiplexed stream, the multiplexer comprising: 



encoders receiving video [[date]] data from a video source, receiving audio data from an 
audio source, encoding the video data into the video elementary data streams, encoding the audio 
data into the audio elementary data streams, dividing the video elementary data streams into a 
plurality of video data units and dividing the audio elementary streams into a plurality of audio 
data units; 

a data memory storing the plurality of video and audio elementary data streams; 
an instruction memory storing multiplexing an instruction [[data]] set ; 



units- 



be multiplexed ; 




data units sequentially from the memory in a predetermined 



a bus; 
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a direct memory access (DMA) circuit for connection to the bus for directly accessing the 
plurality of video and audio elementary data streams stored in the data memory and accessing the 
multiplexing instruction [[data]] set stored in the instruction memory, wherein each video and 
audio elementary data streams is stored as data units in the data memory, and the multiplexing 
instruction [[data]] set state location of data units in the data memory [[in]] and an order of 
multiplexing the corresponding data units; 

wherein the multiplexer is operable to generate a multiplexed stream by reading 
multiplexing instruction set data sequentially with said DMA circuit from the instruction 
memory, by reading data units sequentially from the data memory with said DMA circuit in a 
predetermined order from storage locations stated in based upon the read multipl e xing 
instruction [[data]] set, and by outputting the read data units as said multiplexed stream. 

22. (Currently Amended) The multiplexer of claim 2 1 , wherein the multiplexing 
instruction [[data]] set includes command instruction data having stated therein an instruction for 
data processing to be executed in an arbitrary position in the multipl e xing instruction [[data]] set, 
and the multiplexer is further operable to output command data having stated therein the 
instruction stated in the command instruction data, when having read the command instruction 
data; 

the multiplexer further including a command executing means which is supplied with the 
generated multiplexed stream and which performs processing corresponding to an instruction 
stated in the command data when the data in the input multiplexed stream is command data, or 
outputs the input multiplexed stream as it is when the data in the input multiplexed stream is 
elementary data stream. 
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23. (Previously Presented) The multiplexer of claim 22, wherein: 

the multiplexer outputs, synchronously with the multiplexed stream supplied to the 
command executing means, an ID flag for identifying if the data in the multiplexed stream is 
command data or elementary data stream; and 

the command executing means determines based on the ID flag, if the data in the supplied 
multiplexed stream is command data or elementary data stream. 

24. (Previously Presented) The multiplexer of claim 22, wherein: 

when the command instruction data has stated therein an instruction for inserting stuffing 
data and amount of the stuffing data, wherein the generated multiplexed stream outputs 
command data having stated therein the content stated in the command instruction data, the 
command executing means inserts, when the command data has stated therein an instruction for 
inserting the stuffing data, stuffing data whose amount is stated in the command data to a 
position of the command data in the multiplexed stream. 

25. (Previously Presented) The multiplexer of claim 22, wherein: 

when the command instruction data has stated therein a data delete instruction and data 
amount to be deleted, the generated multiplexed stream outputs command data having stated 
therein the content stated in the command instruction data, and the command executing means 
deletes, when the command data has stated therein an instruction for deletion of the data, an 
amount of data stated in the command data from a multiplexed stream next to the command data. 
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26. (Previously Presented) The multiplexer of claim 22, wherein: 

when the command instruction data has stated therein an instruction for insertion of the arbitrary 
data, the generated multiplexed stream means outputs the command data having stated therein 
the content stated in the command instruction data, and the command executing means inserts, 
when the command data has stated therein an instruction for insertion of the arbitrary data, the 
arbitrary data stated in the command data to a position of the command data in the multiplexed 
stream. 

27. (Previously Presented) The multiplexer of claim 22, wherein: 

when the command instruction data has stated therein an instruction for sending a timing 
acknowledgement, the generated multiplexed stream means outputs the command data having 
stated therein the content stated in the command instruction data, and the command executing 
means sends, when the command data has stated therein an instruction for sending the timing 
acknowledgement, the timing acknowledgement in a position of the command data in the 
multiplexed stream. 

28. (Currently Amended) The multiplexer according to claim 2 1 , further comprises: 

a counting means for indicating a count which indicates a data occupancy of the data 

memory; 

wherein the data amount of a data unit corresponding to the multiplexing instruction 
[[data]] set is added to the count; and 
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the counting means is operable to subtract the data amount of output data unit from the 

count. 



29, (Currently Amended) The multiplexer of claim 28, wherein: 

the data memory is divided into a plurality of storage areas corresponding to the types of 
the elementary data streams and the supplied elementary data streams are stored into 
corresponding storage areas; 

the counting means holds a plurality of counts corresponding to the storage areas in the 
data memory; 

the data amount of a data unit corresponding to the multiplexing instruction [[data]] set is 
added to a count corresponding to a storage area in which the data unit is stored; and 

the counting means subtracts the data amount of data unit output from the data memory 
from a count corresponding to the storage area in which the data unit is stored. 

30. (Currently Amended) The multiplexer according to claim 21, wherein: 

the multiplexer is operable to generate a plurality of multiplexed streams by reading the 
multiplexing instruction [[data]] set from the instruction memory, by reading the data units 
sequentially from the storage locations stated in the read multiplexing instruction [[data]] set, and 
by outputting the read data units; 

the multiplexing instruction [[data]] set states the type of a multiplexed stream resulted 
from multiplexing data units corresponding to the multiplexing instruction [[data]] set; and 
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the multiplexer is operable to generate the plurality of multiplexed streams by switching 
the outputting of the read data unit corresponding to the multiplexed stream type stated in the 
read multiplexing instruction [[data]] set[[,]] • 



3 1 . (Currently Amended) An apparatus for multiplexing a plurality of video 
elementary data streams and a plurality of audio elementary data streams to generate a 
multiplexed stream, the apparatus comprising: 

a bus; 

encoders receiving video [[date]] data from a video source, receiving audio data from an 
audio source, encoding the video data into the video elementary data streams, encoding the audio 
data into the audio elementary data streams, dividing the video elementary data streams into a 
plurality of video data units and dividing the audio elementary streams into a plurality of audio 
data units; 

a data memory linked to the bus; 

an instruction memory linked to the bus; 

a CPU linked to the bus for generating multiplexing an instruction [[data]] set having 
stated therein a storage location in the data memory of a data unit formed from an elementary 
stream and an order of multiplexing the data units and for storing the generated multiplexing 
instruction [[data]] set into the instruction memory in an order corresponding to the multiplexing 
of the data units; and 
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a multiplexer for reading the instruction set and for multiplexing the plurality of video 
elementary data streams and the plurality of audio elementary data stream to generate a 
multiplexed stream, the multiplexer comprising: 

a direct memory access (DMA) circuit for connection to the bus for directly accessing the 
plurality of video and audio elementary data streams stored in the data memory and accessing the 
instruction [[data]] set stored in the instruction memory, wherein each video and audio 
elementary data streams is stored as data units in the data memory, and the multiplexing 
instruction [[data]] set state the storage location of data units in the data memory [[in]] and an 
order of multiplexing the corresponding data units; 

wherein the multiplexer is operable to generate a multiplexed stream by reading 
multiplexing instruction [[data]] set sequentially with said DMA circuit from the instruction 
memory, by reading data units sequentially from storage locations in a predetermined order 
stated in the read multiplexing instruction [[data]] set, and by outputting the read data units as 
said multiplexed stream, and 

wherein the direct memory access (DMA) circuit is connected to said bus for directly 
accessing the plurality of video and audio elementary data streams stored in the data memory and 
directly accessing the multiplexing instruction data stored in the instruction memory. 

32. (Currently Amended) The apparatus of claim 3 1 , wherein: 

the CPU generates multiplexing the instruction [[data]] set and command instruction data 
having stated therein an instruction for data processing to be executed in an arbitrary position in 
the m«4tiplex4Bg instruction [[data]] set, and stores the generated multiplex ing instruction [[data]] 
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set and command instruction data into the instruction memory in an order corresponding to th e 
multiplexing of the d ata units and execution instruction; 

the multiplexer generates a multiplexed stream including the elementary data streams and 
command data by reading the multiplexing instruction [[data]] set and command instruction data 
sequentially from the instruction memory, reading the data units sequ e ntially from the storage 
locations in the predetermined order stated in the read multip lexing instruction [[data]] set and 
outputting the read data units, when having read the multiplexing instruction [[data]] set, or 
outputting command data having stated therein the execution instruction stated in the command 
instruction data, when having read the command instruction data; and 

the apparatus further including a command executing means which is supplied with the 
multiplexed stream and performs processing corresponding to an instruction content stated in the 
command data when the data row in the input multiplexed stream is command data, or outputs 
the input multiplexed stream as it is when the data row in the input multiplexed stream is 
elementary data stream. 

33. (Previously Presented) The apparatus of claim 32, wherein: 

the multiplexer outputs, synchronously with the multiplexed stream, an ID flag for 
identifying if the data in the multiplexed stream is command data or elementary data stream; and 

the command executing means determines, based on the ID flag, if the data in the 
supplied multiplexed stream is command data or elementary data stream. 

34. (Previously Presented) The apparatus of claim 32, wherein: 
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the CPU generates, when inserting stuffing data into an output multiplexed stream, 
command instruction data having stated therein an instruction for inserting the stuffing data and 
amount of the stuffing data; 

the multiplexer outputs, when the read command instruction data has stated therein an 
instruction for inserting the stuffing data, the command data having stated therein the content 
stated in the command instruction data; and 

the command executing means inserts, when the command data has stated therein an 
instruction for inserting the stuffing data, stuffing data whose amount is stated in the command 
data to a position of the command data in the multiplexed stream. 

35. (Previously Presented) The apparatus of claim 32, wherein: 

the CPU generates, when deleting data from an output multiplexed stream, command 
instruction data having stated therein a data delete instruction and data amount to be deleted; 

the multiplexer outputs, when the read command instruction data has stated therein an 
instruction for deletion of data, the command data having stated therein the content stated in the 
command instruction data; and 

the command executing means deletes, when the command data has stated therein an 
instruction for deletion of the data, an amount of data stated in the command data from a 
multiplexed stream next to the command data. 

36. (Previously Presented) The apparatus of claim 32, wherein: 
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the CPU generates, when inserting arbitrary data into an output multiplexed stream, 
command instruction data having stated therein an instruction for insertion of the arbitrary data; 

the multiplexer outputs, when the read command instruction data has stated therein an 
instruction for insertion of the arbitrary data, the command data having stated therein the content 
stated in the command instruction data; and 

the command executing means inserts, when the command data has stated therein an 
instruction for insertion of the arbitrary data, the arbitrary data stated in the command data to a 
position of the command data in the multiplexed stream. 

37. (Previously Presented) The apparatus of claim 32, wherein: 

the CPU generates, when sending a timing acknowledgement in an arbitrary timing in an 
output multiplexed stream, command instruction data having stated therein an instruction for 
sending a timing acknowledgement; 

the multiplexer outputs, when the read command instruction data has stated therein an 
instruction for sending the timing acknowledgement, the command data having stated therein the 
content stated in the command instruction data; and 

the command executing means sends, when the command data has stated therein an 
instruction for sending the timing acknowledgement, the timing acknowledgement in a position 
of the command data in the multiplexed stream. 

38. (Currently Amended) The apparatus according to claim 31, further comprising: 
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a counting means in the multiplexer for indicating a count which indicates a data 
occupancy of the memory; 

wherein the CPU adds the data amount of a data unit corresponding to the generated 
multipl exing instruction [[data]] set to the count; and 

wherein the counting means subtracts the data amount of output data unit from the count. 

39. (Currently Amended) The apparatus of claim 38, wherein: 

the data memory is divided in a plurality of storage areas corresponding to the types of 
the elementary data streams and the supplied elementary data streams are stored into 
corresponding storage areas; 

the counting means holds a plurality of counts corresponding to the storage areas in the 
data memory; 

the CPU adds the data amount of a data unit corresponding to the generated multipl e xing 
instruction [[data]] set to a count corresponding to a storage area in which the data unit is stored; 
and 

the counting means subtracts the data amount of data unit output from the data memory 
from a count corresponding to the storage area in which the data unit is stored. 

40. (Currently Amended) The apparatus according to claim 3 1 , wherein: 

the multiplexer generates a plurality of multiplexed streams by reading the m u lti ple xi ng 
instruction [[data]] set sequentially from the instruction memory, reading the data units 



-26- 



00709777 



U.S. Serial No. 10/612,188 PATENT 
Response to Office Action dated October 27, 2009 450100-04648 

sequentially from the storage locations stated in the read multiplexing instruction [[data]] set and 
by outputting the read data units; 

the CPU states, in the m ultiplexin g instruction [[data]] set, the type of a multiplexed 
stream resulted from multiplexing data units corresponding to the generated multiplexing 
instruction [[data]] set; and 

the multiplexer generates the plurality of multiplexed streams by switching the outputting 
of the read data unit according to the multiplexed stream type stated in the read multiplexing 
instruction [[data]] set. 



4 1 . (Currently Amended) A method for multiplexing a plurality of video elementary 
data streams and a plurality of audio elementary data streams to generate a multiplexed stream, 
the method comprising the steps of: 

receiving video data from a video source, receiving audio data from an audio source, 
encoding the video data into the plurality of video elementary data streams, encoding the audio 
data into the plurality of audio elementary data streams, and storing the plurality of video and 
audio elementary data streams in a data memory; 

generating m ultiple xing an instruction [[data]] set having stated therein a storage location 
in the data memory of a data unit formed from an elementary stream and an order of 
multiplexing the data units and for storing the generated multiplexing instruction [[data]] set into 
an instruction memory i n an order corresponding to the multiplexing o f the data -units; 
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using a direct memory access (DMA) circuit in a multiplexer for directly accessing the 
plurality of elementary data streams stored in the data memory and the m^Mplexmg instruction 
[[data]] set stored in the instruction memory; and 

generating a multiplexed stream in the multiplexer by reading multiplexing instruction 
[[data]] set sequentially with said DMA circuit from the instruction memory, by reading data 
units se quentially in a predetermined order from storage locations stated in the read multiplexing 
instruction [[data]] set, and by outputting the read data units as said multiplexed stream. 

42. (Currently Amended) The method of claim 41 , further comprising the steps of: 

generating command instruction data having stated therein an instruction for execution of 
a data processing to be executed in an arbitrary position in the multiplexing instruction [[data]] 
set, and storing the generated multiplexing instruction [[data]] set and command instruction data 
into the instruction memory in an order of multiplexing data units and execu tion instruction; 

generating one multiplexed stream including the elementary data streams and command 
data by reading the multiplexing instruction [[data]] set and command instruction data 
sequentially from the memory, reading the data units s e quentia lly in a predetermined order from 
the storage locations stated in the read multiplexing instruction [[data]] set and outputting the 
read data units, when having read the multiplexing instruction [[data]] set, or outputting 
command data having stated therein the execution instruction stated in the command instruction 
data, when having read the command instruction data; and 
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processing the multiplexed stream according to an instruction content stated in the 
command data when the data in the multiplexed stream is command data, or outputting the 
multiplexed stream as it is when the data in the multiplexed stream is elementary data stream. 

43. (Previously Presented) The method of claim 42, wherein: 

an ID flag for identifying if the data in the multiplexed stream is command data or 
elementary data stream is provided synchronously with the multiplexed stream; and 

determining based on the ID flag if the data in the multiplexed stream is command data or 
elementary data stream. 

44. (Previously Presented) The method of claim 42, wherein: 

when inserting stuffing data into the multiplexed stream, there is generated command 
instruction data having stated therein an instruction for inserting the stuffing data and amount of 
the stuffing data; 

when the read command instruction data has stated therein an instruction for inserting the 
stuffing data, outputting the command data having stated therein the content stated in the 
command instruction data; and 

when the command data has stated therein an instruction for inserting the stuffing data, 
inserting, stuffing data, whose amount is stated in the command data, at the position of the 
command data in the multiplexed stream. 
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45. (Previously Presented) The method of claim 42, wherein: 

when deleting data from the multiplexed stream, generating command instruction data 
having stated therein a data delete instruction and data amount to be deleted; 

when the read command instruction data has stated therein an instruction for deletion of 
data, outputting the command data having stated therein the content stated in the command 
instruction data; and 

when the command data has stated therein an instruction for deletion of the data, deleting 
an amount of data, stated in the command data, from the multiplexed stream next to the 
command data. 

46. (Previously Presented) The method of claim 42, wherein: 

when inserting arbitrary data into the multiplexed stream, generating command 
instruction data having stated therein an instruction for insertion of the arbitrary data; 

when the read command instruction data has stated therein an instruction for insertion of 
the arbitrary data, outputting the command data having stated therein the content stated in the 
command instruction data; and 

when the command data has stated therein an instruction for insertion of the arbitrary 
data, inserting the arbitrary data stated in the command data to a position of the command data in 
the multiplexed stream. 
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47. (Previously Presented) The method of claim 42, wherein: 

when sending a timing acknowledgement in an arbitrary timing in the multiplexed 
stream, generating command instruction data having stated therein an instruction for sending a 
timing acknowledgement; 

when the read command instruction data has stated therein an instruction for sending the 
timing acknowledgement, outputting the command data having stated therein the content stated 
in the command instruction data; and 

when the command data has stated therein an instruction for sending the timing 
acknowledgement, sending the timing acknowledgement in a position of the command data in 
the multiplexed stream. 

48. (Currently Amended) The method according to claim 41 , further comprising the 
steps of: 

adding the data amount of a data unit corresponding to the generated multiplexing 
instruction [[data]] set to a count in a counter indicating data occupancy of the data memory; and 

subtracting the data amount of data unit output from the data memory from the count. 

49. (Currently Amended) The method of claim 48, wherein: 
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dividing the data memory in a plurality of storage areas corresponding to the types of the 
elementary data streams and storing the supplied elementary data streams into corresponding 
storage areas; 

holding a plurality of counts corresponding to the storage areas in the data memory; 

adding the data amount of a data unit corresponding to the generated multiplexing 
instruction [[data]] set to a count corresponding to a storage area in which the data unit is stored; 
and 

subtracting the data amount of data unit output from the data memory from a count 
corresponding to the storage area in which the data unit is stored. 



50. (Currently Amended) The method according to claim 4 1 , further comprising the 
steps of: 

stating, in the multiplexing instruction [[data]] set, the type of a multiplexed stream 
resulted from multiplexing data units corresponding to the generated multipl e xing instruction 
[[data]] set; and 

generating a plurality of multiplexed streams by reading the muMplexing instruction 
[[data]] set se quentially from the instruction memory, reading the data units sequen tially in the 
predetermined order from the storage locations stated in the read multiplexing instruction [[data]] 
set , and by outputting the read data units and by switching the outputting of the read data units 
according to the multiplexed stream type stated in the read multiplex 4ng instruction [[data]] set . 
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